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PROCESS AND FORMAT FOR RELIABLE STORAGE OF DATA 

Field of the Invention 

The present invention relates generally to video image processing and, in particular, 
to a process and apparatus for storing video and text data samples. The present invention 
5 also relates to a computer program product including a computer readable medium having 
recorded thereon a computer program for storing video and text data samples. 

Background 

Due to recent world events, security has become a very important issue. As a result, 
video surveillance systems are increasingly being used both commercially and privately 

10 to monitor areas for security purposes. 

Typically, a video surveillance system comprises one or more storage servers (i.e., 
generally implemented as a general-purpose computer as known to those in the relevant 
art), which receive data from one or more video cameras distributed on a computer 
network. There are a number of issues with controlling such video surveillance systems 

15 that are typically not as prevalent in other video recording applications. Firstly, it is 
important in security implementations to accurately establish the time at which an event 
occurred. Ideally, the frame rate of a network associated with a video surveillance system 
matches received data as closely as possible, to the point of catching the most minor of 
variations between the two. However, the reliability of video surveillance systems can be 

20 significantly reduced due to variability in frame rate of such an associated network, 
especially if the bandwidth of the network is close to being saturated. Entire frames can 
be lost due to such variability. 

A second issue with video surveillance systems is the frequent changes in video 
properties that can occur with such systems. As a video surveillance system attempts to 

25 maintain a balance between recording size and video quality at important times, some 
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aspects of captured video data, such as frame rate, resolution and compression ratio, can 
change dynamically. 

In addition, the efficiency of video surveillance systems can be reduced due to the 
inefficient use of the memory resources of an associated network. For example, in order 
5 to support as many video cameras as possible on one network and to enable the cameras 
to work at adequate frame rates and resolution, the hard disk of an associated storage 
server must be adequately fragmented and utilised. 

Finally, the recoverability of video surveillance systems in the event of a system 
failure, such as abnormal termination, is critical to the effectiveness of such a system. For 
10 example, during a power failure, as much data as possible should be recovered from any 
files that are left inconsistent or corrupt as a result of the system failure. 

Various video surveillance systems have been developed in order to address the 
above issues. However, most of the existing systems, record and store video data in 
proprietary file formats. Such proprietary file formats cannot typically be viewed using 
15 standard media players. 

One known file format used for video/audio data is the Microsoft™ AVI™ (Audio 
Video Interleave) file format. The AVI™ file format is a file specification used with an 
AVI™ media player application or any media player application that can read a file 
configured in accordance with the AVI™ file format. Such a media player application 
20 can be used to capture, edit, and play back video/audio sequences. In general, files 
configured in accordance with the AVI™ file format include multiple data streams (i.e., 
samples) containing samples of different types of data. Most AVI™ sequences use both 
audio and video streams. A simple variation of such an AVI™ sequence uses video data 
and does not require an audio stream. 
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The disadvantage of the AVI™ file format is that the format does not support 






variable frame rates and resolution within a data stream. As such the AVI™ file format is 






unsuitable for video surveillance applications. J 






Another known file format is the Apple™ QuickTime™ file format. Again, the \ 




5 


TM _ . . . TM 

QuickTime file format is a file specification used with a QuickTime media player 






application of the same name or any media player application that can read a file 






configured in accordance with the QuickTime™ file format. The QuickTime™ file 




- 


format provides support for variable video frame rates and resolutions. A detailed i 






description of the QuickTime™ file format can be found in the publication entitled 




10 


"QuickTime File Format", published by Apple Computer Inc. The QuickTime File \ 






Format publication can be found at the website 






http://develoDer.aDole.com/techpubs/quicktime/qtdevdocs/PDF/OTFi leFormat.odf, as of 9 






January 2003. 






However, there is no structure specified for a media data area within the 




15 


QuickTime™ file format. Accordingly, metadata that can be recognised by a 






QuickTime™ media player application, for example, can not be added to a file configured 






in accordance with the QuickTime™ file format. 






Thus, a need clearly exists for a process for storing data and, in particular, video and 






text data samples, which allows video streams or samples to be captured and viewed S 




20 


using standard file formats and associated standard media players. 






Summary 






It is an object of the present invention to substantially overcome, or at least i 






ameliorate, one or more disadvantages of existing arrangements. 






According to one aspect of the present invention there is provided a method of 




25 


storing data, said method comprising the steps of: 






generating at least one media file for storing data as one or more data samples; and 
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generating at least one index file for storing information indicating the 
configuration of said one or more data samples of said media file, wherein said media file 
contains redundant information which allows reconstruction of said media file upon 
corruption thereof. 

5 According to another aspect of the present invention there is provided a method of 

storing video and associated text data, said method comprising the steps of: 

generating at least one media file in accordance with a first file format, said media 
file being configured for storing said video and associated text data as one or more data 
samples; and 

10 generating at least one index file in accordance with a second file format, said index 

file being configured to store information indicating the configuration of said one or more 
data samples of said media file; and 

adding information to said media file, wherein said media file including said added 
information can be read by a media player corresponding at least to said first file format. 
15 According to still another aspect of the present invention there is provided a method 

of storing at least text data in one or more files as one or more data samples, said method 
comprising the steps of: 

storing a text string in said file corresponding to at least one of said samples, in 
accordance with a first predetermined data format; 
20 generating at least one copy of said text string; and 

storing said copy of said text string in said file in accordance with a second 
predetermined data format. 

According to still another aspect of the present invention, there is provided an 
apparatus for implementing any one of the aforementioned methods. 
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According to still another aspect of the present invention there is provided a 




computer program product including a computer readable medium having recorded 


- 


thereon a computer program for implementing any one of the methods described above. 




Other aspects of the invention are also disclosed. 


5 


Brief Description of the Drawings 




One or more embodiments of the present invention will now be described with 




reference to the drawings and appendices, in which: 


- 


Fig. 1 is schematic diagram of a video surveillance system upon which 




arrangements described can be practiced; 


10 


Fig. 2 shows the relationship between an index file and a media file; 




Fig. 3 shows an example of the placement of a text sample within a media file 




configured in accordance with the AVI™ file format; I 




Fig. 4(a) shows a corrupt AVI™ file; j 




Fig. 4(b) shows a valid AVI™ file; 


15 


Fig. 5 is a flow diagram showing a process for storing video and text data samples; 




Fig. 6 is a flow diagram showing a process for initialising video files; 




Fig. 7 is a flow diagram showing a process for generating a media file; 




Fig. 8 is a flow diagram showing a process for generating an index file; 




Fig. 9 is a flow diagram showing a process for adding a track to an index file l 


20 


reference; | 




Fig. 10 is a flow diagram showing a process for creating a track to media file 




reference; 




Fig. 1 1 is a flow diagram showing a process for adding a sample (i.e., a frame) to a j 




video track; \ 


25 


Fig. 12 is a flow diagram showing a process for adding a string to a text track 




process; 
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Fig. 13 is a flow diagram showing a process for adding a sample to a track; 
Fig. 14 is a flow diagram showing a process for adding a sample to a media file; 
Fig. 1 5 is a flow diagram showing a process for adding a sample reference to an 
index file; 

5 Fig. 16 is a flow diagram showing a process for adding empty samples for a media 

file; 

Fig. 17 is a flow diagram showing a process for completing an index file; 
Fig. 18 is a flow diagram showing a process for completing a media file; 
Fig. 19 is a flow diagram showing is a flow diagram showing a process for 
10 configuring a track; 

Fig. 20 is a flow diagram showing a process for recovering media and index files; 
Fig. 21 is a flow diagram showing a process for opening a damaged media file; 
Fig. 22 is a schematic block diagram of a general-purpose computer upon which a 
viewer described herein can be practiced; and 
15 Fig. 23 is a schematic block diagram of a general-purpose computer upon which a 

storage server described herein can be practiced. 

Detailed Description including Best Mode 
Where reference is made in any one or more of the accompanying drawings to steps 
and/or features, which have the same reference numerals, those steps and/or features have 
20 for the purposes of this description the same function(s) or operation(s), unless the 
contrary intention appears. 

It is to be noted that the discussions contained in the "Background" section relating 
to prior art arrangements relate to discussions of documents or devices which form public 
knowledge through their respective publication and/or use. Such should not be 
25 interpreted as a representation by the present inventor(s) or patent applicant that such 
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documents or devices in any way form part of the common general knowledge in the 
relevant art. 

For ease of explanation the following description has been divided into Sections 
1.0 to 5.0, each section including associated sub-sections. 
5 1 .0 VIDEO SURVEILLANCE SYSTEM OVERVIEW 

A process 500 (see Fig. 5) for storing video and text data samples, is described 
below with reference to Figs. 1 to 23. In one arrangement, the process 500 can be 
implemented within a video surveillance system 100, such as that shown in Fig. 1. The 
system 100 comprises video cameras 110, 111, 112 and 113 connected to a 
10 communications network 2220, such as the Internet or an Intranet. Each of the cameras 
1 10, 1 1 1, 1 12 and 1 13 is independently responsible for the capture of video data. 

The system 100 also comprises a viewer 2200 for processing and displaying 
captured video data. As seen in Fig. 22, the viewer 2200 is preferably formed by a 
computer module 2201, input devices such as a keyboard 2202 and mouse 2203, output 
15 devices including a printer 2215, a display device 2214 and loudspeakers 2217. A 
Modulator-Demodulator (Modem) transceiver device 2216 is used by the computer 
module 2201 for communicating to and from the communications network 2220, for 
example connectable via a telephone line 2221 or other functional medium. The 
modem 2216 can be used to obtain access to the communications network 2220 
20 implemented in the form of the Internet or any other network system, such as a Local 
Area Network (LAN) or a Wide Area Network (WAN). The modem 2216 may be 
incorporated into the computer module 2201 in some implementations. 

The computer module 2201 typically includes at least one processor unit 2205, and 
a memory unit 2206, for example formed from semiconductor random access memory 
25 (RAM) and read only memory (ROM). The module 2201 also includes a number of 
input/output (I/O) interfaces including an audio-video interface 2207 that couples to the 
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video display 2214 and loudspeakers 2217, an I/O interface 2213 for the keyboard 2202 
and mouse 2203 and optionally a joystick (not illustrated), and an interface 2208 for the 
modem 2216 and printer 2215. In some implementations, the modem 2216 may be 
incorporated within the computer module 2201, for example within the interface 2208. A 
5 storage device 2209 is provided and typically includes a hard disk drive 2210 and a 
floppy disk drive 221 1 . A magnetic tape drive (not illustrated) may also be used. A CD- 
ROM drive 2212 is typically provided as a non-volatile source of data. The 
components 2205 to 2213 of the computer module 2201, typically communicate via an 
interconnected bus 2204 and in a manner, which results in a conventional mode of 

10 operation of a computer system as known to those in the relevant art. Examples of 
computers on which the described arrangements can be practised include IBM-PC's and 
compatibles, Sun Sparcstations or alike computer systems evolved therefrom. 

The video surveillance system 100 also comprises storage servers 2300A and 
2300B connected to the communications network 2220. The storage servers 2300A and 

15 2300B are used for recording (i.e., requesting and storing) video data, for accessing video 
data, for event handling and for the control of the system 100. The storage servers 2300A 
and 2300B will hereinafter be generically referred to as the storage server 2300, excepting 
where explicitly distinguished. The storage server 2300 is shown in detail in Fig. 23. 

The storage server 2300 is preferably formed by a computer module 2301, input 

20 devices such as a keyboard 2302 and mouse 2303, output devices including a 
printer 2315, a display device 23 14 and loudspeakers 2317. A Modulator-Demodulator 
(Modem) transceiver device 23 16 is used by the computer module 2301 for 
communicating to and from the communications network 2220, for example connectable 
via a telephone line 2321 or other functional medium. The modem 2316 can be used to 

25 obtain access to the Internet, and other network systems, such as a Local Area Network 
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(LAN) or a Wide Area Network (WAN), and may be incorporated into the computer 
module 2301 in some implementations. 

Similar to the computer module 2201, the computer module 2301 typically includes 
at least one processor unit 2305, and a memory unit 2306, for example formed from 
5 semiconductor random access memory (RAM) and read only memory (ROM). The 
module 2301 also includes an number of input/output (I/O) interfaces including an audio- 
video interface 2307 that couples to the video display 2314 and loudspeakers 2317, an I/O 
interface 2313 for the keyboard 2302 and mouse 2303 and optionally a joystick (not 
illustrated), and an interface 2308 for the modem 2316 and printer 2315. In some 

10 implementations, the modem 2316 may be incorporated within the computer module 
2301, for example within the interface 2308. A storage device 2309 is provided and 
typically includes a hard disk drive 2310 and a floppy disk drive 23 11. A magnetic tape 
drive (not illustrated) may also be used. A CD-ROM drive 2312 is typically provided as a 
non- volatile source of data. The components 2305 to 2313 of the computer module 2301, 

15 typically communicate via an interconnected bus 2304 and in a manner, which results in a 
conventional mode of operation of such a computer system as known to those in the 
relevant art. 

The process 500 is preferably implemented as software, such as an application 
program executing within the computer module 2301 of the storage server 2300. In 

20 particular, the steps of process 500 are effected by instructions in the software that is 
executed by the processor 2305. The instructions may be formed as one or more code 
modules, each for performing one or more particular tasks. The software may be stored 
in a computer readable medium, including the storage devices described below, for 
example. The software is loaded into the computer module 2301 from the computer 

25 readable medium, and then executed by the processor 2305. A computer readable 
medium having such software or computer program recorded on it is a computer program 
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product. The use of the computer program product in the computer preferably effects an 
advantageous apparatus for implementing the methods described herein. 

2.0 STORAGE SERVER FUNCTIONS 

The functionality of the storage server 2300 can be broken up into several 
5 categories, which are listed below. 

2.1 Recording 

The storage server 2300 performs a recording function. The recording function 
comprises requesting and storing video data captured by the cameras 110 to 113, and 
receiving event data from the cameras 1 10 to 113 and various external sources (e.g. heat 
10 sensors, door limit switches, smoke detectors, etc). As will be described in detail below, 
the process 500 for storing video and text data samples is one arrangement of such a 
recording function. 

2.2 Video Access 

The storage server 2300 can also perform a video access function. The video access 
15 function comprises management of video data captured by the cameras 1 10 to 113. Such a 
video access function can also comprise finding a correct video file for a given playback 
request and serving the video data of the file as a data stream to the viewer 2200. 

2.3 Event Handling 

The storage server 2300 can also perform an event handling function. Such an 
20 event handling function can comprise management of events associated with video data 
captured by the cameras 110 to 113. The event handling function can also comprise 
management of events associated with other sensors, such as motion detectors and the 
like. Such events include motion being detected, heat/smoke being detected, a door 
opening/closing, and operator annotations entered via the keyboard 2302, for example. 
25 The event handling function can also comprise an indexing component, which is 

used to analyse the content of video data captured by the cameras 110 to 113. Further, the 
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event handling function can comprise a searching component, used to find a particular 
segment of recorded video data. 

2.4 Control 

The storage server 2300 can also perform a control function for configuring the 
5 system 1 00, providing status reports and starting and stopping the recording of video data. 
Such a control function can also comprise a scheduling component. The scheduling 
component can enable the automatic recording of video data and the filtering of captured 
video data according to specific parameters and/or according to a predetermined schedule. 

2.5 Viewing 

10 The storage server 2300 can also perform a viewing function. Such a viewing 

function provides remote viewing across the network 2200, using the display 2314, for 
example. As such the viewing function can provide an operator interface into recorded 
video data, extracts, events and control. 
3.0 STORAGE SERVER FILE STRUCTURE 

15 The storage server 2300 monitors the output of video data from any one of the 

video cameras 110 to 113. The video data is uploaded, via the communications network 
2220, from any one of the video cameras 110 to 113 to the storage server 2300. The 
video data can be stored on the hard disk drive 2310 so that the video data can be viewed 
at a later stage using the display 2314. Alternatively, the video data can be uploaded from 

20 the hard disk drive 2310 of the storage server 2300 to the viewer 2200 and viewed using 
the display device 2214 of the viewer 2200. 

Additionally, other events can be detected by the storage server 2300. These other 
events can include motion detection using a motion detector (not shown) connected to the 
network 2220, heat/smoke detection using a heat/smoke detector, a door opening/closing 

25 using a limit switch, for example. Representations of such other events can be stored 
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together with any video data received from any one of the cameras 1 10 to 1 13 with which 
the given event is associated. 

Each of the cameras 110 to 113 can output a video data stream. The video data 
stream represents visual information recorded by a particular camera 110 to 113. The 
5 visual information is configured as a sequence of individual frames. 

A text data stream is output by the storage server 2300. The text data stream 
includes the exact time associated with each video frame received by the storage server 
2300 from any one of the cameras 1 10 to 1 13, as well as descriptions of any events that 
are associated with a particular camera 1 10 to 113. 
10 Each distinct portion of data (i.e., a video frame, or a single text string) of a data 

stream is referred to as a sample. 

The storage server 2300 utilises two types of files to store data on the hard disk 
drive 2310. As seen in Fig. 2, a first file 200, referred to as a media file, is used to store 
the video data samples captured by the cameras 110 to 113. The media file 200 stores the 
15 samples (e.g. the sample 201) output by the cameras 110 to 113, representing video 
frames. The media file 200 also stores text samples representing time stamps and event 
notifications. 

A second file 205, referred to as an index file, stores information which instructs a 
media player application (e.g., QuickTime™) as to where to find each sample in the 
20 media file 200, and when each of the samples are to be played by the media player. 

The relationship between the media file 200 and the index file 205 is flexible. As 
described below, the index file 205 contains one or more tracks 213 and 215. Each track 
contains a reference (e.g. the reference 207) to an associated media file 200. As such, an 
index file 205 having more than one track 213 can point to several media files (e.g. the 
25 media file 200). For example, in the instance where one media file (e.g. the media file 
200) contains all video frames while another media file (not shown) contains all event 
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descriptions associated with those video frames, an associated index file (e.g. the file 205) 
can point to both of the media files. 

Further one media file (e.g. the file 200) can be referenced by several index files. 
For example, in the instance where one media file stores samples (i.e., video data) 
5 received from several of the cameras 1 10 to 113, such a media file 200 can be referenced 
by several index files 205. 
3.1 Index File 

The index file 205 is configured in accordance with the QuickTime™ file format. 

The QuickTime™ file format stores data using a special memory structure called an 
10 atom. An atom is a data container specified by the QuickTime™ file format. Each atom 

has an associated type code which specifies the kind of data stored in the associated atom. 

As described above, a detailed description of the QuickTime™ file format and in 

particular, QuickTime™ atoms can be found in the publication entitled "QuickTime File 

Format", published by Apple Computer Inc. 
15 The index file 205 contains all of the atoms that are specified for a QuickTime™ 

file. An atom, referred to as a track atom, stores each track (e.g. the tracks 213 and 215). 

A track associated with a particular track atom contains a pointer (e.g., the media file 

reference 2 1 3) to a media file 200 that is referenced by the track. 

As seen in Fig. 2, each of the tracks 213 and 215 of the index file 205 also contains 
20 a sample-offset table 209 and 217, respectively. The tracks 213 and 215 store offsets to 

each sample (e.g. the sample 201) within the associated media file 200. Each of the 

tracks 213 and 215 of the index file 205 also contains a sample size table 211 and 219, 

respectively. The sample size tables 21 1 and 218 store the size of the samples contained 

in the associated media file 200. 
25 The sample offset tables 209 and 217 and the sample size tables 21 1 and 219, are 

configured to be read by a QuickTime™ media player. As a result, a completed index 
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file 205 can be opened by a QuickTime™ media player, which locates the associated 
media file 200 using the media file reference (e.g. the reference 207) included within a 
track 213 of the index file 205. Additionally, as long as the contents of the completed 
index file 205 are flushed to the hard disk drive 2310 regularly and in a manner that 
5 ensures the consistency of the file 205, the QuickTime™ media player may view an in- 
progress recording up to the point of the last full flush. If there is a system failure, data 
added to the index file 205 after the last time that the file 205 was flushed will be lost 
from the index file 205. 
3.2 Media File 

10 The format of the media file 200 is flexible. Each individual sample (e.g. 201) is 

stored as a single set of consecutive bytes. The following sections 3.2.1, 3.2.1.1 and 
3.2.1.2 describe a preferred format for the media file 200, which is supported by the 
described arrangements. However, a person skilled in the relevant art would appreciate 
that any suitable file format can be used for the media file 200. 

15 3.2.1 AVI™ Media Data Format 

The media file 200 is configured in accordance with the Microsoft™ AVI™ file 
format. The media file 200 is playable by any media player software application that can 
read the AVI™ file format. 

The AVI™ file format has several limitations with regard to the processing of video 

20 data captured with the cameras 110 to 113. Firstly, each AVI™ video data sample is 
played back at a constant frame rate. Thus, changes in frame rate or late frames due to 
network lag can result in the playback rate inaccurately portraying the passage of time. 
Secondly, for an image file configured in accordance with the motion-JPEG (Joint 
Photographies Experts Group) standard, a value representing image resolution is stored 

25 within each JPEG fragment of the image file. However, media players such as the 
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Windows™ Media Player can not scale the image, resulting in sub-optimal playback 
results. 

When the media file 200 is first created, a set of headers is generated. An AVI™ 
header is generated to store general details about the file 200. Further, individual stream 
5 headers are generated to represent each track within the associated index file 205 that 
points to the given media data file. An empty sample list structure is also created to store 
each individual sample (e.g. the sample 201) of the media file 200. 

When the media file 200 is closed, the headers are updated to reflect the number of 
samples that were stored within the media file 200. Further, an associated AVI™ index 
10 (not shown) is appended to the end of the file 200. The AVI™ index is a standard 
structure required by the Windows™ Media Player to play back the video data of an 
AVI™ file 205. 

When inserting a sample (e.g. the sample 201) into an open media file 200, the 
sample is stored within a new sample chunk of the file 200. The stored sample has a 

15 header indicating which data stream the corresponding sample belongs to and the size of 
the sample. Additionally, a special chunk, hereinafter referred to as a 'CNVD* chunk is 
inserted in front of the newly stored sample. The CNVD chunk is configured to be 
ignored by a standard AVI™ media player. The CNVD chunk contains additional 
information, which can be used to recover the media file 200 and the associated index file 

20 205. In particular, the CNVD chunk contains information including the timestamp (i.e., 
in milliseconds) and the resolution of the newly stored sample following the CNVD 
chunk. 

3.2.1 .1 AVI™ Video Stream Handling 

Each video frame of the video data captured by the cameras 1 10 to 1 13 is preferably 
25 configured as a separate JPEG file, which is inserted as a separate sample (i.e., sample 
chunk) within the AVI™ media file 200. 
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3.2.1.2 AVI™ Text Stream Handling 




The QuickTime™ file format specifies that a text string must consist of a 16-bit 


• 


length field, followed by the text string characters. However, the AVI™ file format 




specifies a null-terminated string. In order to allow text strings to be played back 


5 


correctly in both the QuickTime™ and the AVI™ file formats, two copies of the same 




text string are placed within a relevant sample chunk of the media file 200. The first copy I 




of the text string is a null-terminated version of the text string. An AVI™ media player 


- 


automatically locates the first copy at the beginning of the relevant sample of the file 200, 




and discards any data subsequent to the terminating character. The second copy of the text 


! 10 


string is placed immediately after the null character terminating the first copy. The 




second copy is configured in accordance with the QuickTime™ file format. In this case, ] 




the QuickTime™ index file 205 is provided with the offset of the second copy of the 




string, rather than the offset of the beginning of a sample, which the index file 205 




normally uses to reference a corresponding sample. 


15 


As an example, Fig. 3 shows the placement of the text string sample, "Door7A", t 




within a media file 300 configured in accordance with the AVI™ file format. As seen in 




Fig. 3, an AVI™ version 301 and a QuickTime™ version 303 of the text sample are 




included in the file 300. Fig. 3 also indicates the sample offset 305 and the sample size 




308 entries of a corresponding index file (not shown) for the data string "Door7A". In ! 


20 


particular, the sample offset entry 305 points to the beginning of the QuickTime™ 




version 303 of the text sample. Further, the sample size entry 308 provides the size of the 




QuickTime™ version 303. 




4.0 PROCESS FLOW DIAGRAMS 




4.1 Data Storage Method 


25 


The process 500 of storing data will now be described with reference to the flow 




diagram of Fig. 5. As described above, the process 500 is preferably implemented as 
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software resident on the hard disk drive 2310 and being controlled in its execution by the 

processor 2305 of the storage server 2300. 

The process 500 generates a media file 200 and an associated index file 205 for 

video data captured by any one of the cameras 1 10 to 113 over a certain period of time. 
5 Data captured from each camera 110 to 113 is added to a separate index and media file. 

For ease of explanation, the process 500 will be described with reference to video data 

captured by the camera 1 10. 

The process 500 utilises one or more predetermined parameters including a media 

file format parameter, a track capacity parameter, a track rate parameter and a data source 
10 parameter, which will be described below. These predetermined parameters can be 

defined within a configuration file, for example, stored on the hard disk drive 2310. The 

process 500 also utilises one or more other parameters including a media file parameter 

and an index file parameter, which again will be described below. The media file 

parameter and the index file parameter are preferably dynamically generated by the 
15 processor 2305, as the process 500 executes. The media file parameter and the index file 

parameter can be generated using any suitable method that ensures the uniqueness of the 

parameters. 

The process 500 begins at step 501 where the processor 2305 initialises a media file 
200 and an associated index file 205, in the hard disk drive 2310, to be used for video 

20 data captured by the camera 110. As described above, the index file 205 includes at least 
one associated track (e.g. the tracks 213 and 215). The tracks 213 and 215 include a 
reference 207 and/or 205 to the associated media file 200, respectively. The tracks 213 
and 215 also include a sample-offset table 209 and 217, respectively, for storing offsets to 
each sample to be added to the media file 200. The tracks 213 and 215 also includes a 

25 sample size table 21 1 and 219, respectively, for storing the size of each sample added to 
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the media file 200. The process of step 501 will be described in detail below with 
reference to the flow diagram of Fig. 6. 

At the next step 503, if any of the tracks 213 and 215 indicate that the capacity of 
the tracks 213 and 215 have been reached or exceeded, then the method 500 proceeds to 
5 step 527. Otherwise, the method 500 proceeds to step 505. The capacity of the tracks 213 
and 215 is indicated by a capacity value stored together with the index file 205. As will be 
described below, a track structure is created in the index file 205 for each of the tracks of 
the index file 205. The track structure for each track is dependent on the type of track 
(i.e., video track or text track). The capacity value refers to the number of samples that 

10 can be indexed within a track structure of the index file 205. 

At step 505, the processor 2305 waits to detect a next sample (i.e., data stream) 
output from the camera 110, representing a video frame or event. In the described 
arrangements, each frame of video data or text string generated by the camera 110 
constitutes a single sample. 

15 At the next step 507, if the processor 2305 determines that one or more samples 

representing one or more frames or text strings, output from the camera 110, have been 
missed, then the method 500 proceeds to step 509. Otherwise, the method 500 proceeds 
to step 511. At step 509, the processor 2305 advances a time variable referred to as the 
"padding time' 1 variable by a predetermined sample duration. This sample duration is 

20 determined using a predefined frame rate specified by the processor 2305 when creating 
the tracks 213 and 215 of the index file 205. The processor 2305 then inserts empty 
samples, which can be referred to as padding frames, into the media file 200, at step 509, 
if necessary, in order to compensate for the missed samples. The process of step 509 will 
be described in detail below with reference to the flow diagram of Fig. 16. 

25 At step 51 1, the processor 2305 generates a text string to describe the time at which 

the current sample (i.e., frame or text string) is being inserted into the media file 205. 
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Then at the next step 513, if the processor 2305 determines that there are any pending 
events, the method 500 proceeds to step 515. Otherwise, the method 500 proceeds 
directly to step 517. At step 515, text descriptions of the pending events are appended to 
the text string generated at step 511. 
5 The method 500 continues at the next step 517, where if the processor 2305 

determines that the sample detected at step 505 (i.e., the current sample) is a video frame, 
then the method 500 proceeds to step 519. Otherwise, the method 500 proceeds directly 
to step 521. At step 519, the processor 2305 adds the current sample to the media file 
200. The process of step 519 will be described in detail below with reference to the flow 

10 diagram of Fig. 1 1 . 

At step 521, the processor 2305 adds the current sample, in this case a text string, to 
the media file 200. The current sample is referenced by the track 213. The process of 
step 521 will be described in more detail below with reference to flow diagram of Fig. 12. 
The method 500 continues at the next step 523, where the processor 2305 

15 determines if any unwritten index file data in memory 2306 should be flushed to the hard 
disk drive 2310, according to a predetermined flushing interval. Any suitable flushing 
interval that ensures the consistency of the index file 205 can be used. If the processor 
2305 determines that data should be flushed, then the method 500 proceeds to step 525. 
Otherwise, the method 500 returns to step 503. At step 525, the processor writes any 

20 unwritten index file data from memory 2306 to the hard disk drive 2310. 

As described above, if any of the tracks 213 and 215 indicate that the capacity of 
the tracks 213 and 215 have been reached or exceeded, then the method 500 proceeds to 
step 527. At step 527, the processor 2305 completes the index file 205 configured within 
the hard disk drive 2310, and closes the index file 205. The process of step 527 will be 

25 described in detail below with reference to the flow diagram of Fig. 17. 
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The method 500 concludes at the next step 529, where the media file 200 
configured within the hard disk drive 2310, is completed and closed. The process of step 
529 will be described in detail below with reference to the flow diagram of Fig. 1 8. 
4,2 Initialise Video Files Process 
5 The process of step 501 will now be described with reference to the flow diagram of 

Fig. 6. The process of step 501 is preferably implemented as software resident in the hard 
disk drive 2310 and being controlled in its execution by the processor 2305. The process 
of step 501 begins at step 601 where the processor 2305 creates the media file 200 in the 
hard disk drive 2310. The media file 200 is created according to a media file path 

10 parameter and a media file format parameter, which are supplied by the processor 2305. 
The media file format parameter specifies the file format (e.g. AVI™ or QuickTime™) 
for the media file 200. At the next step 603, the processor 2305 creates the index file 205 
in the hard disk drive 2310. The index file 205 is generated based on an index file path 
parameter, which is supplied by the processor 2305. As described above, the index file is 

15 generated in accordance with the QuickTime™ format. 

The process of step 501 continues at the next step 605 where the processor 2305 
creates a first track (e.g. the track 213) based on a track capacity parameter, a track rate 
parameter and a data source identifier parameter supplied by the processor 2305. The 
track created at step 605 (e.g, the track 213) is configured to reference video data samples 

20 to be stored in the media file 200. Also at step 605, the processor 2305 adds the video 
track 213 to the index file 205 configured within the hard disk drive 2310. Then at the 
next step 607, the processor 2305 creates a second track (e.g. the track 215) based on the 
track capacity parameter, the track rate parameter and the data source identifier parameter. 
The second track 215 is configured to reference text strings. Also at step 607, the 

25 processor 2305 adds the created text track 215 to the index file 205. The process of steps 
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605 and 607 will be described in detail below with reference to the flow diagram of Fig. 
9. 

The process of step 501, concludes at the next step 609 where the track references 
for the created tracks 213 and 215 are linked in order to indicate that the created text track 
5 215 refers to descriptions of events that are associated with the video data corresponding 
to the video track 213. 
4.3 Create Media File Process 

The process of step 601 will now be explained with reference to the flow diagram 
of Fig. 7. The process of step 601 is preferably implemented as software resident in the 

10 hard disk drive 2310 and being controlled in its execution by the processor 2305. The 
process of step 601 begins at step 701 where the processor 2305 creates the media file 
200 at a memory address, in the hard disk drive 2310, as specified by the media file path 
parameter supplied by the processor 2305 at step 601. At the next step 703, if the media 
file format parameter specifies that the media file 200 is to be configured in accordance 

15 with the AVI™ file format, then the process of step 601 proceeds to step 705. Otherwise, 
the process concludes. 

At step 705, the processor 2305 creates an empty set of headers and an empty 
sample structure to store the samples detected by the processor 2305, as at step 505 of the 
process 500. Then at step 707, the created sample structures are written to the media file 

20 200 configured within the hard disk drive 2310. The process of step 601 concludes at the 
next step 709 where the processor 2305 creates an AVI™ index file structure. The index 
file structure can be stored either in the memory 2306 or in a temporary file configured 
within the hard disk drive 2310, since the index file structure will be appended to the end 
of the media file 200, the resultant length of which is currently unknown. 

25 4.4 Create Index File Process 
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The process of step 603 will now be explained with reference to the flow diagram 
of Fig. 8. The process of step 603 is preferably implemented as software resident in the 
hard disk drive 2310 and being controlled in its execution by the processor 2305. The 
process of step 603 begins at step 801 where the processor 2305 creates the index file 205 
5 at a memory address, in the hard disk drive 2310, as specified by the index file path 
parameter supplied by the processor 2305 at step 603. Then at the next step 803, the 
processor 2305 initialises a movie header atom for the index file 205. Movie header 
atoms are used to specify the characteristics of an entire QuickTime™ movie and are 
explained in detail in the publication entitled ''QuickTime File Format", published by 

10 Apple Computer Inc., as discussed above. The process of step 603 concludes at the next 
step 805, where the processor 2305 initialises a user data atom for the index file 205. 
User data atoms allow a user to define and store data associated with a QuickTime™ 
object such as a movie. 
4.5 Add Track to Index File Process 

15 The process of steps 605 and 607 will now be described with reference to the flow 

diagram of Fig. 9. The process of step 605 is preferably implemented as software resident 
in the hard disk drive 2310 and being controlled in its execution by the processor 2305. 
The process of step 605 begins at the first step 901 where the processor 2305 creates a 
track structure of a capacity and rate defined by the track capacity parameter and a track 

20 rate parameter, for the index file 205 which is referenced by an index file reference 
supplied by the processor 2305. The track structure is created in accordance with a track 
type (i.e., video track or text track) parameter, supplied by the processor 2305 depending 
on which of the tracks 213 and 215 are being created. At the next step 903, the processor 
2305 initialises a track header atom for the created track structure. Then at step 905, the 

25 processor 2305 initialises a user data atom for the created track structure. 
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The process of step 605 continues at the next step 907, where the sample tables 209 




and 211 are initialised for the created track structure. Then at step 909, the processor 


• 


2305 initialises an empty edit list, which can be used to arrange the media file sample 




structure into a time sequence. The process of step 605 concludes at the next step 91 1 


5 


where a media file reference 209 is written to the track structure created at step 901 in 




order to reference the associated media file 200. The process of step 911 will be 




described in more detail below with reference to Fig. 10. 


- 


4.6 Create Track to Media File Reference Process 




The process of step 911 will now be described with reference to Fig. 10. The 


10 


process of step 91 1 is preferably implemented as software resident in the hard disk drive % 




23 10 and being controlled in its execution by the processor 2305. The process of step 91 1 i 




begins at the first step 1001 where if the processor 2305 determines that the media file 




200, referenced by the media file reference, is in AVI™ format then the process proceeds 




to step 1003. Otherwise, the process of step 91 1 concludes. At step 1003, the processor $ 


15 


2305 creates an AVI™ sample header structure using a track structure reference supplied 




by the processor 2305. Then at the next step 1005, the processor 2305 writes the sample 




header structure to a header area of the media file 200, configured within the hard disk S 




drive 2310. At the next step 1007, the processor 2305 adds a reference for the AVI™ 




sample header to the tracks (213 or 215) of the index file 205 indicated by the track 


20 


structure reference parameter. The process of step 911 concludes at the next step 1009 




where the processor 2305 adds a reference for the media file 200 to each of the track 213 




and 21 5, as the media file reference 207. 




4.7 Add Sample (i.e., Frame) to Video Track Process 




The process of step 5 19 will now be described with reference to the flow diagram of 


25 


Fig. 11. The process of step 519 is preferably implemented as software resident in the 




hard disk drive 2310 and beine controlled in its execution hv the nrocessor 230S The 
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process of step 519 begins at the first step 1101 where if the processor 2305 determines 
that the sample detected at step 505 is the first frame to be associated with the video track 
213 of the index file 205, then the process of step 519 proceeds to step 1105. The 
processor 2305 uses a track structure reference generated by the processor 2305 during 
5 the process of step 605 to identify the video track 213. 

If the current sample is not the first frame to be associated with the video track 213, 
at step 1101, then the process proceeds to step 1 103 where the processor 2305 determines 
whether the video track 213 is configured to accept the current sample. In making the 
determination at step 1 103, the processor 2305 reads a frame data parameter, associated 
10 with the current frame, to determine whether the frame format and resolution of the 
current frame is the same as the previous frame. If the outcome of step 1 103 is true, then 
the process of step 519 proceeds to step 1107. Otherwise, the process proceeds to step 
1105. 

At step 1105, the processor 2305 configures the track 213 according to the frame 
15 format and resolution properties of the current frame. The process of step 1105 will be 
described in more detail below with reference to Fig. 19. The process of step 519 
concludes at the next step 1107 where the processor 2305 adds the frame to the sample 
size table (e.g. the sample size table 21 1) of the track 213. The required frame details are 
determined by the processor 2305 using the frame data, frame data size and frame 
20 recording time parameters associated with the current frame. The processor also adds the 
frame to the media file 200 and adds a reference corresponding to the frame to the sample 
offset table 209 of the track 213. The process of step 1107 will be described in more 
detail below with reference to the flow diagrams of Figs 13 and 14. 
4.8 Add string to text track process 
25 The process of step 521 will now be described with reference to the flow diagram of 

Fig. 12. The process of step 521 is preferably implemented as software resident in the 
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hard disk drive 2310 and being controlled in its execution by the processor 2305. As 
described above, if the processor 2305 determines, at step 517, that the sample detected at 
step 505 is not a video frame (i.e., the sample contains a text string), then the method 500 
proceeds to step 521. The process of step 521 begins at the first step 1201 where the 
5 processor 2305 transforms the sample into the format described above with reference to 
Fig. 3. That is, a first null-terminated copy of the text string contained in the sample is 
created in memory 2306 and a second copy of the text string is configured in accordance 
with the QuickTime™ format. 

At the next step 1203, if the processor 2305 determines that the sample contains any 

10 events, then the process proceeds to step 1205. Otherwise, the process proceeds to step 
1207. At step 1205, the text track 215 (indicated by the track structure reference 
parameter for the text track 215) of the index file 205 is configured for an event stream. 
At step 1207, the text track 215 is configured for a non-event stream. The process of steps 
1205 and 1207 will be described in more detail below with reference to Fig. 19. 

15 The process of step 521 concludes at the next step 1209 where the processor 230, 

using the text string parameter and text string recording time parameter, adds a reference 
to the sample detected at step 505 to the text track 215. The process of step 1209 will be 
described in more detail below with reference to Figs. 13 and 14. 
4.9 Add Sample to Track Process 

20 The process as executed at steps 1 107 and 1209 begins at the first step 1301 where 

the processor 2305 adds the sample detected at step 505 to the media file 200. The 
process of step 1301 will be described more detail below with reference to the flow 
diagram of Fig. 14. The process of steps 1107 and 1209 concludes at the next step 1303, 
where the processor 2305 adds a reference to the sample to either the video track 213 or 

25 the text track 215, of the index file 205. The process of step 1303 will be described more 
detail below with reference to the flow diagram of Fig. 15. 
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4.10 Add Sample to Media File Process 

The process of step 1301 is preferably implemented as software resident in the hard 
disk drive 2310 and being controlled in its execution by the processor 2305. The process 
of step 1301 begins at the first step 1401, where if the processor 2305 determines that the 
5 format of the media file 200 is AVI™ then the process proceeds to step 1403. Otherwise, 
the process of step 1301 proceeds directly to step 1419, where the data of the detected 
sample is written to the media file 200 configured within the hard disk drive 23 10. 

At step 1403, if the sample detected at step 505 is empty (i.e. the associated sample 
size is zero) then the process proceeds directly to step 1415. Otherwise, the process of 
10 step 1301 proceeds to step 1411. 

At step 1411, the processor 2305 creates a custom data chunk containing a 
timestamp based on the detected sample recording time and writes the custom data chunk 
to the media file 200 configured within the hard disk drive 2310. At the next step 1413, 
the AVI™ index is updated with a reference to the custom data chunk stored in the media 
15 file 200. 

At step 1415, the processor 2305 writes a data chunk based on the detected sample 
to the media file 200. The process of step 1301 concludes at the next step 1417 where the 
AVI™ index of the index file 205 is updated with a reference to the custom data chunk 
stored in the media file 200. 

20 4,11 Add sample reference process 

The process of step 1303 will now be described with reference to the flow diagram 
of Fig 15. The process is preferably implemented as software resident in the hard disk 
drive 2310 and being controlled in its execution by the processor 2305. The process of 
step 1303 begins at the first step 1501 where the sample offset indicated by a sample 

25 offset parameter and sample size parameter, of the sample detected at step 505, is written 
to the sample table structure (i.e. the sample offset tables 209 or 217 and the sample size 
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table 211 or 219) of the index file 205 track (i.e., either the video track 213 or the text 
track 215). At the next step 1503, if the sample is the first sample to be associated with 
the track then the process continues at the next then 1505. Otherwise, the process of step 
1303 proceeds to step 1507. 
5 At step 1505, the processor 2305 sets the starting time of the track to the timestamp 

of the current sample using the sample recording time parameter. Otherwise, the 
processor determines the duration of the previous sample by subtracting the timestamp of 
the previous sample from the timestamp of the current sample. Then at the next step 
1509, a track duration value associated with the relevant track (i.e., the track 213 or 215) 

10 is set to the difference between the timestamp of the current sample and the starting time 
of the relevant track. At the next step 1511, if the track duration causes the end of the 
track to exceed the index duration, then the process proceeds to step 1513. Otherwise, the 
process of step 1303 concludes. At step 1513, the index duration is updated to 
accommodate the track and the process of step 1303 concludes. 

15 4.12 Pad Media File Process 

The process of step 509 will now be described with reference to the flow diagram of 
Fig 16. The process is preferably implemented as software resident in the hard disk drive 
2310 and being controlled in its execution by the processor 2305. The process of step 509 
begins at the first step 1601 where a variable referred to as the "padding time" variable is 

20 set to the time of the last added sample. At the next step 1603, the processor 2305 adds a 
predetermined sample duration value to the padding time variable using a current 
recording time parameter supplied by the processor 2305. Then at step 1605, if the 
processor 2305 determines that the value of the padding time variable is greater than or 
equal to the current sample time, then the process of step 509 concludes. Otherwise, the 

25 process continues at the next step 1607 where an empty sample of a duration equal to the 
predetermined sample duration is added to the media file 200. Further, an offset to the 
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empty sample is added to the video track 213 of the index file 205. The process of step 






509 continues at the next step 1609 where an offset to the empty sample is added to the 






text track 215 of the index file 205 and the process of step 509 returns to step 1603. 






4.13 Complete Index File Process 




5 


The process of step 527 will now be described with reference to the flow diagram of 






Fig. 17. The process is preferably implemented as software resident in the hard disk drive 






2310 and being controlled in its execution by the processor 2305. The process of step 527 




- 


begins at the first step 1701 where the processor 2305 sets the end time of the index file 






205 to an index end time value supplied by the processor 2305. At the next step 1703, the 




10 


processor 2305 selects a first track of the index file 205. Then at step 1705 if the 






processor 2305 determines that there are any remaining tracks of the index file 205 to be 






processed the process of step 527 proceeds to step 1707. Otherwise, the process proceeds 






to step 1711. At step 1 707, the end time for the selected track is set to the index end time ' 






supplied by the processor 2305. The next track of the index file 205 is then selected by 




15 


the processor 2305 at step 1709 and the process of step 527 returns to step 1705. 






At step 1711, the processor 2305 flushes any previously unwritten index file data in 






memory 2306 to the index file 205 configured in the hard disk drive 2310. The process of 






step 527 then concludes at the next step 1713, where the index file 205 is closed. 






4.14 Complete Media File Process 




20 


The process of step 529 will now be described with reference to the flow diagram of 






Fig 18. The process is preferably implemented as software resident in the hard disk drive 






2310 and being controlled in its execution by the processor 2305. The process of step 529 






begins at the first step 1801, where if the processor 2305 determines that the media file 






200 is formatted in accordance with the AVI™ file format, then the process of step 529 




25 


proceeds to step 1803, Otherwise, the process proceeds to step 1809 where any 






previously unwritten media file data in memory 2306 is flushed to the media file 200 
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configured within the hard disk drive 2310. After step 1809 the process of step 229 




proceeds directly to step 1807. At step 1803, the processor 2305 updates the AVI™ 


• 


headers of the media file 200 with information about the samples stored in the media file j 




200. At the next step 1805, the AVI™ index file 205 is written to the end of the media 


5 


file 200. The process of step 529 concludes at the next step 1807 where the media file 200 




is closed. 




4.15 Configure Track Process 


- 


The process of step 1 105 will now be described with reference to the flow diagram 




of Fig 19. The process is preferably implemented as software resident in the hard disk 


10 


drive 2310 and being controlled in its execution by the processor 2305. The process of $ 




step 1 105 begins at the first step 1901, where if the video track 213 of the index file 205 




is configured in accordance with the properties of the current sample (i.e., the current 




frame), then the process of step 1105 proceeds to step 1905. Otherwise, the processor 




2305 checks a list configured within memory 2306 to determine if the requested 


15 


combination of file format (i.e., indicated by a data encoding parameter) and frame 




dimensions (i.e., indicated by a frame dimensions parameter), is present in the list. If the 




requested combination is not present in the list, then the processor 2305 creates a new 




track configuration in accordance with the requested properties and stores the new 




configuration in the list. The process then proceeds to step 1905 where the processor ; 


20 


2305 sets the video track configuration to the configuration of the current sample or to the 




new configuration created at step 1903. The process of step 1 105 then concludes. 




5.0 MEDIA AND INDEX FILE RECOVERY 




In the event of system failure of the storage server 2300 occurring (e.g. due to a 




power failure), the contents of the index file 205 may not be entirely consistent with all of ! 


25 


the data that was stored in the associated media file 200 before the system failure. As long 




as the data of the index file 205 was regularly flushed to the hard disk drive 2210, the 
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impact of such a system failure is not as severe. However, the data that was saved to the 
media file 200 after a most recent flush can be lost. 

Additionally, corruption of the media file 200 can occur, in that any metadata of the 
media file 200 may not be consistent with the contents of the file 200. As such, the media 
5 file 200 is unplayable in a standard media player. For example, if the media file 200 is in 
AVI™ format, the size of the sample list of the media file, which is typically updated 
only when recording to the file 200 has finished, will not be consistent with the contents 
of the sample list. 

As an example, Fig. 4(a) shows a sample list chunk 400 from a corrupt AVI™ file, 
10 where the recorded size of the sample list chunk 400 is represented by the arrow 405. In 
the file of Fig. 4(a), the recorded size of the sample list chunk 400 does not match the 
actual size of the sample list chunk 400. In contrast, Fig. 4(b) shows a similar portion of a 
valid AVI™ file, where the recorded size of a corresponding sample list chunk 401 is 
represented by the arrow 407. In this example, an AVI™ index chunk cannot be written 
15 to the end of the file of Fig. 4(a) since the processor 2305 of the storage server 2300 is not 
able to ascertain where the end of the file of Fig. 4(a)is located. However, an AVI™ 
index chunk can be written to the end of the file of Fig. 4(b) since the processor 2305 can 
determine where the end of the file is using the recorded size of the sample list chunk 
401. 

20 As described above, additional, non-standard, information inserted into the media 

file (e.g. the file 401) at various points during the capturing and storing of the samples, 
can ensure that a corrupt media file (e.g. the file 400) can still be reconstructed. Likewise, 
a fresh index file that references all samples that were written to the media file 401 before 
a system failure, can be created. 

25 For example, as described above, when a media file such as the media file 401 is in 

AVI™ format, CNVD sample chunks (e.g. the chunk 403) can be inserted into the file 
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401 during recording in order to provide timestamps for each frame of video data 
captured by the cameras 110 to 113. As a result, the index file 401 can contain 
information on frame rate variation, which is not present in a conventional AVI™ file. 

As described in detail below, the media file 200 is read by the processor 1305 and if 
5 the media file 200 was not closed correctly, the processor 2305 closes the media file 200 
in accordance with the process of step 529. The processor 2305 then reconstructs a new 
index file in memory 2306 based on data stored in the media file 200. The existing index 
file 205 configured within the hard disk drive 2310 is then replaced with the new index 
file. 

10 5.1 Recover Media and Index Files Routines 

A process 2000 for recovering damaged media and index files will now be 
described with reference to the flow diagram of Fig. 20. The process is preferably 
implemented as software resident in the hard disk drive 2310 and being controlled in its 
execution by the processor 2305. The process 2000 restores a damaged media file and 

15 associated index files into a consistent and incorrupt state. 

The process 2000 begins at the first step 2001, where the processor 2305 opens a 
damaged media file configured within the hard disk drive 2310 and determines whether 
the format of the damaged file can be recognised. The name of the damaged media file 
can be provided to the processor 2305 in a command line argument, for example, input 

20 via the keyboard 2302. The process of step 2001 will be described in more detail below 
with reference to the flow diagram of Fig. 2 1 . 

The process 2000 continues at the next step 2003 where the processor 2305 
determines if the damaged media file is valid. The damaged media file is considered to 
be valid if the media file is in a state from which the associated index file can be rebuilt. 

25 If the processor 2305 determines that the damaged media file is valid at step 2003, then 
the process 2000 proceeds to the next step 2005. Otherwise, the process proceeds to step 
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2031. At step 2005, if the processor 2305 determines that the damaged media file is 
configured in accordance with the AVI™ file format, then the process proceeds to step 
2007. Otherwise, the process proceeds to step 203 1 . 

At step 2007, the processor 2305 creates an index file, in accordance with the 
5 process of step 603, described above with reference to Fig 8. At the next step 2009, 
tracks are added to the newly created index file in accordance with the process of step 605 
described above with reference to Fig. 9. The created index file is created with one or 
more tracks depending on the samples present within the damaged media file. 

The process 2000 continues at the next step 201 1 where the processor 2305 sets the 

10 current time for all tracks of the media file to zero. At the next step 2013, the processor 
2305 cycles through the sample list of the media file and if there are any unprocessed 
samples (i.e., chunks) remaining in the sample list, then the process proceeds to step 
2015. Otherwise, the process proceeds to step 2029 where the newly created index file is 
completed in accordance with the process of step 527, described above with reference to 

15 Fig. 17. Following step 2029, the process 2000 proceeds step 2031 . 

At step 2015, the processor 2305 selects a next sample (i.e., chunk) from the sample 
list. Then at step 2017, if the selected sample is a data sample (i.e., a video or text data 
sample), the process proceeds step 2019. Otherwise, the process proceeds to step 2021, 
where if the selected sample is a "CNVD" chunk, then the process 2000 proceeds to step 

20 2027. If the selected sample is not a CNVD chunk, then the process returns to step 2013. 
At step 2027, the current time for all tracks of the newly created index file is set to the 
value of a time stamp indicated within the selected sample and the process 2000 returns to 
step 2013. 

At step 2019, the processor 2305 determines the track of the newly created index 
25 file, corresponding to the selected sample. Then at the next step 2023, a reference 
corresponding to the selected sample is added to the associated track, in accordance with 
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the process of step 1303 described above with reference to Fig. 1 5. Then at step 2025, the 




current time for the selected track is advanced by a default sample duration corresponding 


■ 


to the associated track and the process returns to step 2013. 




Once all of the samples within the sample list have been processed, the media file is 


5 


closed at step 203 1 and the process 2000 concludes. 




5.2 Open Damaged Media File Process 




The process of step 2001 for opening damaged media files will now be described 


- 


with reference to the flow diagram of Fig. 21. The process of step 2001 is preferably 




implemented as software resident in the hard disk drive 2310 and being controlled in its 


10 


execution by the processor 2305. The process of step 2001 begins at the first step 2101, 




where the processor 2305 opens a damaged media file indicated by a media file name 




supplied by the processor 2305 and being configured within the hard disk drive 2310. At 




the next step 2103, if the processor 2305 determines that the damaged media file is 




configured in accordance with the AVI™ file format, then the process proceeds to step 


15 


2105. Otherwise, the process of step 2001 concludes. 




At step 2105, the processor 2305 reads the headers corresponding to each of the 




streams of the damaged media file, in order to determine the nature (i.e., video or text) of 




the samples contained within the damaged media file. At the next step 2107, the j 


• 


processor 2305 locates the sample list of the damaged media file. Then at the next step 


20 


2109, if the processor 2305 determines that there is a chunk after the sample list, the 




process of step 2001 proceeds to step 2111. Otherwise, the process proceeds to step 




2119. At step 21 1 1 , the processor 2305 examines the chunk following the sample list. If 




the chunk belongs to the sample list at the next step 2113, then the process of step 2001 




proceeds to step 2115. Otherwise, the process proceeds to step 2119. $ 


25 


At step 2115, the sample list is resized to contain the chunk and the process of step 




2001 returns to step 2109. Thus, the sample list is continually resized until either the end ! 
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of the media file is reached, or a sample is encountered that does not belong. inside the 
sample list (e.g. the AVI™ index). 

At step 2119, the processor 2305 writes the final size of the sample list to the media 
file configured within the hard disk drive 2310. At the next step 2121, an AVI™ index 
5 file is generated to reference the offsets and sizes of each sample within the sample list. 
The process of step 2001 concludes at the next step 2123 where the AVI™ index is 
appended to the end of the sample list. 

The aforementioned preferred method(s) comprise a particular control flow. There 
are many other variants of the preferred method(s) which use different control flows 
10 without departing the spirit or scope of the invention. Furthermore one or more of the 
steps of the preferred method(s) may be performed in parallel rather than sequentially. 

The methods described above may alternatively be implemented in dedicated 
hardware such as one or more integrated circuits performing the functions or sub 
functions of described processes. Such dedicated hardware may include graphic 
15 processors, digital signal processors, or one or more microprocessors and associated 
memories. 

The foregoing describes only some embodiments of the present invention, and 
modifications and/or changes can be made thereto without departing from the scope and 
spirit of the invention, the embodiments being illustrative and not restrictive. 
20 In the context of this specification, the word "comprising" means "including 

principally but not necessarily solely" or "having" or "including", and not "consisting 
only of. Variations of the word "comprising", such as "comprise" and "comprises" have 
correspondingly varied meanings. 
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The claims defining the invention are as follows: 



1 . A method of storing data, said method comprising the steps of: 

generating at least one media file for storing data as one or more data samples; and 
5 generating at least one index file for storing information indicating the 

configuration of said one or more data samples of said media file, wherein said media file 
contains redundant information which allows reconstruction of said media file upon 
corruption thereof 

10 2. A method according to claim 1, wherein said index file can be regenerated based on 
said redundant information. 

3. A method according to claim 1, wherein said media file is reconstructed based on a 
sample list contained in said media file. 

15 

4. A method according to claim 3, wherein sample references are added to said index 
file based on said sample list. 

5. A method according to claim 1, wherein said redundant information includes a 
20 timestamp indicating capture time of an associated sample. 

6. A method according to claim 1, wherein said redundant information includes a 
resolution of an associated sample. 

25 7. A method according to claim 1, wherein said information of said index file includes 
frame rate variation information. 
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8. A method according to claim 1, wherein said redundant information is stored as a 
dedicated sample of said media file. 

5 9. A method according to claim 1, wherein said media file is configured in accordance 
with the Microsoft™ AVI™ file format. 

10. A method according to claim 1, wherein said index file is configured in accordance 
with the Apple™ QuickTime™ file format. 

10 

10A. A method according to any one of claims 1 to 10, wherein said data is video data. 



10B. A method according to claim 1 to 10, wherein said data is text data. 



15 10C. A method according to claim 1 to 10, wherein said data is video data and associated 
text data. 

11. A method according to claim 10C, wherein said video and associated text data is 
captured for security purposes. 

20 

12. A method according to claim 10A or 10C, wherein each video sample is a separate 
JPEG file. 

13. A method according to claim 10B or 10C, wherein a plurality of copies of a 
25 corresponding text string are included in each text sample of said media file. 
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14. A method according to claim 13, wherein a first copy of said text string is 
configured in accordance with the AVI™ file format. 

15. A method according to claim 13, wherein a second copy of said text string is 
5 configured in accordance with the QuickTime™ file format. 

16. A method according to claim 1, further comprising the step of inserting one or more 
empty samples into said media file to compensate for any missed samples. . 

10 17. A method according to claim 1, wherein said index file contains a track referencing 
at least said media file. 

18. A method of storing video and associated text data, said method comprising the 
steps of: 

15 generating at least one media file in accordance with a first file format, said media 

file being configured for storing said video and associated text data as one or more data 
samples; and 

generating at least one index file in accordance with a second file format, said index 
file being configured to store information indicating the configuration of said one or more 
20 data samples of said media file; and 

adding information to said media file, wherein said media file including said added 
information can be read by a media player corresponding at least to said first file format. 

19. A method according to claim 18, wherein said added information allows 
25 reconstruction of said media file upon corruption thereof. 
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20. A method according to claim 18, wherein said index file can be regenerated based 
on said added information. 

21. A method according to claim 18, wherein said media file is reconstructed based on 
5 a sample list contained in said media file. 

22. A method according to claim 21, wherein sample references are added to said index 
file based on said sample list. 

10 23. A method according to claim 18, wherein said added information includes a 
timestamp indicating capture time of an associated sample. 

24. A method according to claim 18, wherein said added information includes a 
resolution of an associated sample. 

15 

25. A method according to claim 18, wherein said information of said index file 
includes frame rate variation information. 

26. A method according to claim 18, wherein said added information is stored as a 
20 dedicated sample of said media file. 

27. A method according to claim 18, wherein said first format is the Microsoft™ 
AVI™ file format. 

25 28. A method according to claim 18, wherein said second file format is the Apple™ 
QuickTime™ file format. 
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29. A method according to claim 18, wherein said video and associated text data is 
captured for security purposes. 

5 30. A method of storing at least text data in one or more files as one or more data 
samples, said method comprising the steps of: 

storing a text string in said file corresponding to at least one of said samples, in 
accordance with a first predetermined data format; 

generating at least one copy of said text string; and 
10 storing said copy of said text string in said file in accordance with a second 

predetermined data format. 

31. A method according to claim 30, where said first predetermined format is the 
Microsoft™ AVI™ file format. 

15 

32. A method according to any one of claims 30 or 31, where said second 
predetermined format is the Apple™ QuickTime™ file format. 

33. An apparatus configured to implement the steps of any one of claims 1 to 32. 

20 

34. A computer program product including a computer readable medium having 
recorded thereon a computer program for implementing the steps of any one claims 1 to 
32. 
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35. A method of storing video and associated text data, said method being substantially 
as hereinbefore described with reference to any one of the embodiments as that 
embodiment is illustrated in the accompanying drawings. 

DATED this Thirteenth Day of January 2003 
CANON KABUSHIKI KAISHA 
Patent Attorneys for the Applicant 
SPRUSON&FERGUSON 
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